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Abstract 

Fix a bounded domain Q C M. d , a continuous function F : dQ — ► R, and constants 
e > and 1 < p, q < oo with p _1 + g _1 = 1. For each x G f2, let be the value 

for player I of the following two-player, zero-sum game. The initial game position is x. 
At each stage, a fair coin is tossed and the player who wins the toss chooses a vector 
v £ -B(0,e) to add to the game position, after which a random "noise vector" with 
mean zero and variance ^\v\ 2 in each orthogonal direction is also added. The game 
ends when the game position reaches some y € <9f2, and player I's payoff is F(y). 

We show that (for sufficiently regular $7) as e tends to zero the functions u e converge 
uniformly to the unique p-harmonic extension of F. Using a modified game (in which 
e gets smaller as the game position approaches d£l), we prove similar statements for 
general bounded domains Q and resolutive functions F. 

These games and their variants interpolate between the tug of war games studied by 
Peres, Schramm, Sheffield, and Wilson [p = oo) and the motion-by-curvature games 
introduced by Spencer and studied by Kohn and Serfaty {p = 1). They generalize 
the relationship between Brownian motion and the ordinary Laplacian and yield new 
results about p-capacity and p-harmonic measure. 

1 Introduction 

Given p > 1, a bounded domain Q in R d and a continuous function F : dQ — > R, the 
p-Dirichlet problem consists of finding a continuous extension u : Q —>■ M. of F which is p- 
harmonic, that is, u minimizes J n \Wu(x)\ p dx subject to the given boundary conditions. (In 
general, such an extension exists only under a regularity condition on Q, and J \ Vu(x)\ p dx 
should be minimized over compact subsets of Q, see Proposition 11.31 ) In the classical case 
p = 2, Kakutani and Doob discovered that the Dirichlet problem can be solved by starting 
a Brownian motion B at x, running it until the hitting time r of dQ, and taking u(x) = 
K x [F(B(r)))] see [5] for a comprehensive study. 

In this paper, we develop an analogous interpretation of a p-harmonic extension u(x) as 
the limit of the values of certain stochastic games. The extreme case p = oo was already 
considered in |14j . 
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1.1 Game definition 

Fix a bounded domain Q C M d and a continuous function F : dQ — > R. Let /x be a 
mean zero compactly supported probability measure on M d that is preserved by orthogonal 
transformations of IR d that fix the first basis vector e\. We call /x the noise measure. (For 
example, /x can be the uniform distribution on the sphere of radius r in the hyperplane 
orthogonal to e\\ for the relation to the p-Laplacian described below to hold, r should be 
y/(d- l)q/p.) 

For each v G M. d and Borel measurable S C M d , define fj, v (S) = /x(\l/ _1 (S)) where \& is 
a constant c times some orthonormal transformation of M. d , chosen so that ^(ei) = v. The 
requirement that \I/(ei) = v clearly implies that c = |u|. In particular, if v = cei for some 
c > 0, then the law of a vector chosen from /x„ will be simply the law of c times a vector 
chosen from /x. The fact that /x is invariant under orthogonal transformations of IR d that fix 
e\ implies that our definition of ri v does not depend on the choice of ty. 

Let a = 1 + inf{i? : riB(0, i?) = 1}, where _B(z, i?) denotes the ball of radius R centered 
at z. 

We now introduce a two-player zero-sum game, called tug of war (with noise) , played 
as follows. Fix an initial game state xq = x G Q. At the fc'th turn, a fair coin is tossed, and 
the player who wins the coin toss is allowed to make a move. If dist(;r&_i, dQ) > as, then 
the moving player chooses Vk G M d with |t> fc | < e and sets Xk = x^-i + v k + where Zk is a 
random "noise vector" sampled from ri Vk . To understand the scaling, observe that the law 
ii Vk of the noise vector is supported on a set of radius [a — l)|ffc|; thus, we expect Zk and Vk 
to be of the same order of magnitude. 

If dist(xfc_i, dQ) < ae, then the moving player chooses an Xk G dQ with \xk — Xk-i\ — ae 
and the game ends, with player I receiving a payoff of F(xk) from player II. The rules above 
ensure that if the game terminates at the fc'th step, then Xj G Q for all < j < k and 
Xk G dQ. Both players receive a payoff of zero if the game never terminates. Tug of war in 
a domain of M. d without noise (i.e., with /x supported at the origin) was introduced in [14J, 
where it was used to give uniqueness results for PDEs involving the infinity Laplacian and 
also extended to solve the optimal Lipschitz extension problem on general length spaces. 
Other games with random turn order were introduced earlier [TBI, [TP] . 

1.2 Main results 

Fix the game parameters F, Q, and /x above, and denote by u\(x) the supremum over all 
player I (measurable, pure) strategies (defined precisely in Section I2TTI) of the infimum over 
all player II strategies of the expected payoff for player I when both players adopt these 
strategies. Denote by u\(x) the infimum over all player II strategies of the supremum over 
all player I strategies of the expected payoff for player I when both players adopt these 
strategies. It is clear that u\ < u\. When u\ = u\ we say that the game has value 
u e = u\ = u\. 

A function u is p-harmonic in a domain Q C M d if u is continuous on Q and for every 
bounded subdomain Q of Q such that Q C Q, the p-energy f Uo \ Vu(x)\ p dx of u in Q is 
finite and as small as possible, given the values of u on dQ . (We give equivalent viscosity 
and weak p-Laplacian-based definitions in Section [Ol where we will also define the terms u p- 
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Figure 1: A move of tug of war with noise in dimension 2, for the noise distribution p, given 
by p{(0,r)} = p{(0,—r)} = 1/2. The player who wins the coin toss adds a vector Vk of 
length at most e to the the game position Xk-i, and then a random noise vector Zk with law 
p Vk (and magnitude r\vk\) is added to produce Xk- In the figure \vk\ — e. 

superharmonic" and "p-subharmonic." ) Note that the continuity assumption can be replaced 
by a weaker regularity assumption, and that p-harmonic functions are the same as harmonic 
functions when p = 2. 

Let ilj denote projection to the ith coordinate. The covariance matrix 



of the noise measure p is necessarily diagonal with C^i = Cjj for all 2 < i, j < d. The main 
result of this paper is that as e tends to zero, the functions u\ and u\ converge uniformly to 
the unique p-harmonic extension of F (at least when F is continuous and Q is sufficiently 
regular), where p is determined as follows: Given p, we define a constant p = p(p) G [1, oo] 
by V — C ' 1 ' 1 ~c^ 2 2 2+1 ■ Equivalently; V is such that for some (3 > 0, we have Ci ; i + 1 = fiq' 1 and 
Ci t i = /3p~ x for 2 < % < d, where p" 1 + q~ x = 1. This p is chosen so that if one player always 
chooses the vector Vk to be some v with \v\ = e, and the other player always chooses Vk to be 
—v, then for each k the variance of Xk — Xk-i is proportional to q~ l e 2 in the direction of v and 
p^e 2 in each direction orthogonal to v. In other words, q~ x and p~ l are the relative sizes 
of the parallel and perpendicular variance when the players "tug" in opposite directions. 
The case p = oo corresponds to purely parallel variance and p — 1 to purely perpendicular 
variance. 

We now describe the required regularity condition on Q. For a given noise measure p and 
p = p(p), a point y G dfl is called a game-regular boundary point of Q if whenever the game 
starts near that y, player I has a strategy for making the game terminate near y with high 
probability. More precisely, y is game-regular if for every 5 > and rj > there exists a 
Sq and e such that for every x with \xq — y\ < 5$ and e < eo, player I has a strategy that 
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guarantees that an e-step game started at xq will terminate at a point on dQ D B(y, 5) with 
probability at least 1 — rj. We say Q itself is game-regular if every y £ dQ is game-regular. 
We say that a point y £ <9f2 satisfies the cone property if there is a neighborhood [7 of y 
and a cone C with tip y such that C fl [7 is disjoint from f2. We say that Q satisfies the cone 
property if every y £ <9f2 satisfies the cone property. The following results will be proved in 
Section H 

Proposition 1.1. Let Q be a bounded domain in M. d and fix a noise measure ri and p = 
£ (l,oo) as above. Then 

(i) If p > d then Q is game-regular. 

(ii) Every y £ dfl that satisfies the cone property is game-regular. 

(iii) If d = 2 and Q is simply connected then Q is game-regular. 

Theorem 1.2. Let Q be a bounded domain in lR d . Fix a noise measure fi and p = p{[i) £ 
(l,oo). 

(i) Suppose Q is game-regular and F : dQ — > R is continuous. Then as e — > 0, the game 

values u\ and u\ converge uniformly to the unique p-harmonic function u that extends 
continuously to F on dfl. 

(ii) Conversely, ifVL is not game regular, then there exists a continuous function F : dVt — > 
M. for which u\ does not converge uniformly to a function that extends continuously to 

on. 

Section [3] extends the above results to two natural variants of tug of war. The first 
is the same as the game described above except that the players alternate turns instead 
of deciding turn order with coin tosses. Alternating turn tug of war without noise is not 
interesting (since either player may choose a strategy of always undoing the other player's 
moves, thereby preventing the game from terminating), but the values in alternating turn 
tug of war with noise converge to p-harmonic functions for an appropriate choice of p. The 
second variant interpolates between tug of war without noise (p = 00) and certain optimal 
control processes introduced by Spencer nearly thirty years ago [16] and studied in detail by 
Kohn and Serfaty [8] (p — 1). 

Analogous results for discontinuous boundary conditions and non-regular domains are 
presented in Section 0J Nonmeasurable strategies are briefly discussed in Section El and 
some unsolved problems are collected in the final section. 

1.3 Motivation 

In the case p = 00, the tug of war games without noise were used to prove new uniqueness 
results for A^u = g, to solve the optimal Lipschitz extension problem on general length 
spaces, and to give various bounds on infinity harmonic measure [H]. We hope that the 
results of this paper will be similarly useful to the study of p-harmonic measure and p- 
capacity. In Section 14.31 we will see that some of the bounds in [TJ] translate to the p- 
harmonic case as well. In particular, the question of how the p-harmonic measure of a 5 
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neighborhood of a Cantor set decays as 5 tends to zero can be easily addressed using game 
theoretic arguments. 

Furthermore, although the games in [15] were applied to solve problems in analysis, the 
authors of [15] (including the current authors) were originally motivated by the games them- 
selves. We expect that tug of war games will have applications to political and economical 
modeling. They are natural models for situations in which the relevant state space is well 
summarized by finitely many parameters and in which opposing parties continually seek to 
improve their positions though incremental "tugs." They are related to many of the differ- 
ential games (in which players choose drift and diffusion terms at each point in a domain) 
used in economic modeling, but they are particularly simple in that the move sets are player- 
symmetric, and each player's allowed set of incremental moves is independent of anything 
the other player does. Barron, Evans, and Jensen have recently developed some continuous 
time variants of tug of war without noise in which both players specify a control flow on 
the entire domain Q in advance, and then the game position alternates randomly between 
evolving according to one player's control and evolving according to the other player's control 
until it reaches the boundary [3]. 

1.4 More definitions and background about j>harmonicity 

On the space of real- valued functions on a subset Q C R , we define the infinity Laplacian 
operator A^ by A^u = \Vu\~ 2 J2i,j u i u j u ij- ( Here u i = J|>) 

When u is twice different iable and Vw 7^ 0, the infinity Laplacian is the second derivative 
of u in the gradient direction. For more on the infinity Laplacian, see the survey paper pp. 
We similarly define the 1-Laplacian Ai = A — Aoo where An = Ylt=i u n * s the ordinary 
Laplacian. In other words, Aiu is the sum of the second derivatives in each of the d — 1 
directions orthogonal to Vw. 

For 1 < p < 00, a function that minimizes J \Wu(x)\ p dx (given its boundary values) 
solves the Euler Lagrange equation 

div(|Vu| p - 2 Vu) = 0. (1) 

When u is smooth, we can write the left hand side as 

i=l M 

= ^|v«|^«« + ^ Mi A((|v M p)^) 

1=1 1=1 1 

= \vur 2 Au+Y Ul p —\wur 4 ^-\vu\ 2 

11 ^ 2 1 1 dxi 1 

i=i 

d d 

= \Vu\ p ~ 2 Au+ {p-2)\Vu\ p - 4 J2J2 u * u v u i 

i=l j=l 

= p\Vu\ p - 2 (p~ 1 A 1 + g^AoJ u. 
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If Vu 7^ 0, then the last expression vanishes precisely when p~~ l Ai + g _1 Aoo = 0. Thus, 
for general 1 < p, q < oo (with p~ l + q^ 1 = 1), it is natural to define an operator Ap to 
be the convex combination of Ai and Aqo given by A^ := p^Ai + q^A^. Since A^ and 
Aj differ only by a normalization factor of p\Vu\ p ~ 2 , the equation A^ u = is equivalent in 
the classical sense to the Euler-Lagrange equation A^u = (provided Vu ^ 0). It is also 
equivalent in the weak sense as well as the viscosity sense, as discussed below. Note that if 
Vti(x) = 0, then ApU(x) is undefined in the classical sense (as is A^u(x) when p < 2). 

In much of the literature, the p-Laplacian is set to zero, so the distinction between A^ 
and Ap is irrelevant. The equations A^u = g for non-zero constant functions g have a 
natural variational interpretation in terms of minimizing the p-energy of u conditioned on 
the volume J n u(x)dx bounded underneath u. However, the solution u of A^u = g = —2f/(3 
has a natural game-theoretic interpretation as the limiting value of a modified tug of war 
game in which in addition to the payoff player I receives when the game terminates, player I 
receives a "running payoff" of size f{xk)e 2 at the kth step of the game. (See [2] for complete 
details in the case p = oo.) The normalization A^ also has the aesthetic advantage of being 
a convex combination of Ai and A^. Throughout the remainder of this paper, when we use 
the term p-Laplacian, or write A p , we will always mean A^ . 

We say that u is a viscosity subsolution to A p (-) = g in an open set U if u is upper 
semi-continuous and for every x G U and C 2 function on a neighborhood of x such that 

1. <f>(x) = u(x), 

2. u < <p in a neighborhood of x, 

3. V0(x) ^ 0, 

we have A p (p(x) > g(x). We say u is a viscosity supersolution to A p (-) = g if — u is a 
viscosity subsolution to A p (-) = —g. We make similar definitions for A^ and observe that u 
is a viscosity subsolution to A p u = if and only if it is a viscosity subsolution to A^u = 0. 
(In the latter case, when p > 2, the relevant comparison functions <fi are those that have 
Aj <fi(x) > at x, which in turn implies V0 ^ and A p 0(x) > 0.) 

Both [7] and [6] define p-harmonic functions to be weak solutions to A^u = 0: precisely, 
a function u on a domain Q is called p-harmonic in Q (for 1 < p < oo) if it is continuous 
and belongs to the Sobolev space W^(Q) (i.e., Vu G Lf oc (f2)) and 

/ \Vu\ p - 2 (Vu, V<p)dx = (2) 
Jn 

for every G C^°(Q). (This is the distributional form of flTJ).) Say that u : Q — > (— oo, oo] is 
p-superhamonic if u is lower semicontinuous, m ^ oo, and w satisfies the following comparison 
principle on each bounded subdomain Q with Q c fi: if /i G C(fio) is p-harmonic in Q 
and m > h on 9f2o, then u > /i in Qq- We say u is p-subharmonic if — u is p-superharmonic. 
We now cite the following: 

Proposition 1.3. When 1 < p < oo, a function is p-superharmonic in Q if and only if it is 
a viscosity p-supersolution. Moreover, u is p -harmonic (equivalently, a viscosity p-solution) 
if and only if u is a continuous solution to the variational problem, i.e., for every subdomain 
Qq with compact closure Qq C Q, the integral J n \Vu\ p is finite and as small as possible, 
given the values of u on dQo . 
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The viscosity and weak equivalence was proved in [TJ. The equivalence of (j2J) with the 
variational problem is classical Euler-Lagrange theory; see, e.g., the reference text [6] on non- 
linear potential theory. Recall that Wo' p (f2) is the closure in W 1,p of the smooth functions 
supported on compact subsets of Q. From Chapter 3 and Chapter 5 of [6] we cite the 
following: 

Proposition 1.4. If Q C M. d is bounded and 9 G W 1,P (Q), then there exists a unique p- 
harmonic function u in Q such that u — 6<E Wq' p (Q); moreover, this u minimizes the integral 
f n \Vu\ p among all functions v G W 1,P (Q) for which v — 6 G W Q ' P (Q). 

Proposition 1.5. If Q is bounded and <ft G C(Q) is p-harmonic in Q, then any p-harmonic 
function which extends continuously to the boundary of Q and agrees with <p on the boundary 
of Q is equal to 0. 

We also quote the following smoothness result, which was proved by DiBendetto [4] and 
independently by Tolksdorf |17j . who extended earlier work by Morrey, Uhlenbeck, Evans 
and others. 

Proposition 1.6. If u is p-harmonic in Q, then it is everywhere differentiable in Q and real 
analytic wherever Vu ^ 0. Moreover, u has a Holder continuous gradient — i.e., u G C ln (VL) 
for some 7 > 0. 



2 Proofs 



2.1 Strategy definition 

When two players play tug of war, we define the history up to step k of the game to be 
the sequence hf. = {x , Vi,x±, v 2 , x 2 , ■ ■ ■ , u*., Xk}. (If the game terminated at time j < k, we 
set v m — and x m = Xj for m > j.) This belongs to the space H k = Q x (5(0, e) x {l) k . 
The complete history space is the set of all infinite game position sequences h = 
{xo,vi,x 1 ,v 2 ,x 2 , ■ • •}• 

We endow with the product topology. It is easy to see that if F : dfl — ► R is Borel 
measurable, then the payoff for player I is a Borel measurable function on H^. A (mea- 
surable pure) strategy is a sequence of Borel measurable maps from Hk to -8(0, e), giving 
the move a player would make at the kth step of the game as a function of the game history. 
A pair of strategies a = (Si, Su) (where Si is a strategy for player I and Sn is a strategy 
for player II) and a starting point x determine a unique probability measure P x in HI (con- 
structed using Kolmogorov's extension theorem). Denoting the corresponding expectation by 

E x , the expected payoff for this strategy pair is V(Si, Su) = E x F(x T )l T<00 where r is the 

exit time of fl. We then have u\ = sup 5/ infs 7/ V(Si, Su) and u 2 = inis n supg, V(Si, Su). 

The restriction to Borel measurable strategies is necessary since \i is a Borel measure. 
It is also natural, since measurable strategies are in some sense the only ones that can be 
implemented in a constructive way. (We mention some relaxations of the measurability 
condition in Section 0) 
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2.2 Smooth case, non-vanishing gradient 

If a; is a matrix or column vector, denote by x T the transpose of x. Suppose that z has law 
u, and Z\ = ^(z) has law ji v (where \1> is a rotation multiplied by \v\ and ^(e\) = v). As 
noted above, z has mean zero and covariance matrix 

C z = (Pq- 1 - l)e ie f + Pp-\I - e x el). 

Therefore, z\ has mean zero and covariance matrix 

C Z1 = {fig' 1 - l)vv T + Pp-\\v\ 2 I - vv T ). 

Next, we need some basic lemmas about quadratic functions. Let <p(x) = x T Ax + 
(for £ G W 1 \ {0}) be a quadratic function. Without loss of generality, A is a symmetric 
matrix, since only the quadratic form induced by A is used. Suppose that x = and let 
ipiv) be the expected value of <fi(xi) = 0(t>i + zi) if player I chooses v\ = v. Let z\ denote 
the ith component of z\. Since E^i = 0, we have 

1>(v) := E<f)(v + Zl ) = 4>{v) + J2 A,M4 = 4>{v) + £ AijCfr 
Note that J2i,j(vv T ) itj A id = v T Av and h,j A d = TrA. Therefore 

if,( v ) = (j)( v ) + (pq- 1 - l)v T Av + Pp-\\v\ 2 TrA-v T Av) 
= <j>{v) + (Pq- 1 - pp' 1 - l)v T Av + Pp-^v^TrA 
= (Pq' 1 ~ Pv~ l )v T Av + /3p">| 2 TrA + {£,v), 

whence ipiy) = (£,v) + v T Bv where B = (Pq~ l — Pp _1 )A + / 3p~ 1 (TrA)J. In the following, 
we use the L 2 operator norm on matrices given by \\B\\ = supi„| =1 \Bv\. 

Lemma 2.1. Fix £ G R d \ {0} ; and let ( = If e < C" 1 , then any v G -8(0, e) for which 

ip(v) = (£,f) + v T Bv is maximal within B(0,e), satisfies \v\ = e and\v — (e|£| -1 0l — C f2 - 

Proof. We first observe that the maximum of ip within B(0, e) is obtained on the boundary 
dB(0, e): Otherwise Vip(v) = £ + 2Bv must vanish at the maximum, but 

\2Bv\ < 2\\B\\e < 2||B||C _1 < 

Let w = el^l^ 1 ^. Then ip{y) > ip{w) = e|£| + w T Bw. This means 

> e|f| +w T Bw -v T Bv > e|£| - 2\\B\\e\v - w\. 

Multiplying by e|£| _1 gives 

C 

(w,v) > e -e -\v-w\, (3) 

whence 

\v — w\ 2 = 2e 2 — 2(w, v) < (\v — w\e 2 . 

□ 
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Lemma 2.2. Given v, ip, B, and £ as in the statement Lemma \2.1\ we have the following 
approximation ofip(v): 



i/j(v) - e|£| - A QO V(0)e72 < e 3 , 



for all e < 1 . 

Proof. Since A OO , 0(O) is the second derivative of -0 in the £ direction, the vector w = e|^| -1 ^ 
satisfies ip(w) = e|£| + A oo -?/'(0)e 2 /2. Let £ be as in Lemma I2TT1 Recall that \v\ — \w\ — e and 
\w-v\< Ce 2 . By ©, 

n e2 C , e 4 C 2 

(w, W — f ) < -r-p — W\ < ——. 



Therefore, 



\ip(v) -VHI < — |(w,tu- , u)| + 2||B||e|t;-tw| 

< %C! +2 | |B || C£ 3 = 1W £ 3. 

□ 

If ||-B|| is bounded above and |£| is bounded below, then Lemma 12.21 implies that the 
expected change in <p when player I makes an optimal move is the same as the expected 
change when player I moves in the gradient direction, up to an error of 0(e 3 ). These 
estimates deteriorate badly when |£| tends to zero and \\B\\ gets large. However, they are 
enough to prove the following: 

Lemma 2.3. Let <p(x) = x T Ax + (£,x). Fix k > and suppose that player Fs strategy in 
move k + 1 is to tug distance e in the gradient direction of if player I wins the coin toss. 
Then regardless of player IFs strategy, we have 

K[<P(x k+1 )\h k ] > (j)(x k ) + ^A p( j)(x k )e 2 - Me 3 , 

where 

h k = {x , vi, xi, v 2 , x 2 ,..., v k , x k } 
is the game history up to step k and M = 16 P( d +VW A W _ 

Proof. Recall that tp(v) = (£, v) + v T Bv where B = (fiq- 1 - fip~ x )A + f3p~ l (TiA)F Thus 

Aoo^(O) = (fa' 1 - Pp-^A^ + Pp^Acf) = /3A P 0(O). 
Lemma [2.21 implies that if player I adopts the strategy in the statement, then 

E[0(z fe+1 )|/4] > 4>{x k ) + e|f | + ^A p <p(x k )e 2 - Me 3 , 

where h l k indicates that in move k + 1, player I won the coin toss and chooses v k+ \, whence 
the conditional expectation is simply integrating with respect to fJ, Vh+1 - Minimizing ip over 
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B(0, e) is the same as maximizing — if> there. Now — if) is obtained from if) by replacing £ and 
B by — £ and —B, respectively. Therefore, Lemma [2.21 also implies that regardless of player 
IPs strategy, we have 

E[0(x fe+1 )|^] > <f>(x k ) - e|£| + ^A p( p(x k )e 2 - Me 3 , 

where the conditional expectation is integrating with respect to fi Vk+1 as before, but now v k+ x 
was chosen by player II. Averaging the last two displayed equations proves the lemma. □ 

Given a differentiate function u with no n- vanishing gradient, the gradient strategy 
for player I is to always take 

v k = e|Vu(a; fc _i)| _1 VM(2; fc _i) 

at every step of the game regardless of what player II does. The gradient strategy for 
player II is to always take v k = — e|Vw(:Cjfc-i)|~ 1 Vix(2;fc-i). We can interpret Lemma [2731 as a 
bound on the expected change in u when the gradient strategy is employed. 

Theorem 2.4. Suppose thatu is p -harmonic on a domainQ' andVu ^ throughout Q' . Let 
Q be a domain whose closure is a compact subset ofQ'. Fix a noise measure ri. For x G VL, let 
u\(x) be the value for player I of the game in Q, started at xq = x, with boundary conditions 
F = u on dQ. Then the functions u\ converge uniformly to u. In fact, \u\ — m|oo = 0(e). 
(The implied constant may depend on fi.) 

Proof. We may assume (adding a constant if necessary) that u > on fi. By Proposition 
ll.6[ u is real analytic in Q', and in particular its derivatives restricted to Q are all bounded. 
We thus have the Taylor expansion at any y e Q given by u(x) = u(y) + (Vw, (x — y)) + 
|(x — y) T (D 2 u)(x — y) + 0((x — y) 3 ). Thus, at every x, the function <f>(x) = (Vu,y) + (x — 
y) T D 2 u(x — y) approximates u up to an error of 0(e 3 ) within the ball of radius 2(a + l)e of 
y. The bounds in Lemma 12.31 then imply that player I, by adopting the gradient strategy, 
can ensure that for some constant c the sequence M k = u(xk) + eke 3 is a submartingale. 

The non-vanishing gradient and compactness imply that for some c\ > 0, we have u(xk) — 
u(xk-i) > C\e provided player I wins the coin toss and e is small enough. Therefore E[(Mfc — 
M k _i) 2 \h k _{\ > \c\e 2 . Consequently, the difference M| — Mq — c 2 e 2 /c, where c 2 = cf/2, is a 
submartingale, because 

E[M 2 k - M^I/i^J = E[(M k - M k ^) 2 \h k ^] + E[2(M fc - M k ^)M k ^\h k ^}, 

and the second term on the right hand side is non-negative. 

Suppose that player I adopts the gradient strategy and player II adopts some arbitrary 
strtaegy Su. Use ¥ x to denote probability when the initial game position is xo = x. Then 
have 

c 2 k¥ x [T>k] < C2E x [rAk] 

< e~ 2 E x [M 2 Ak — Mq] 

< e- 2 (8|| M ||^ + 2c 2 Pe 6 ), 
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so P x (r > ae~~ 2 ) < 1/2 for some a (independent of e). 

Since this holds uniformly in e and x, iteration shows that can be bounded by a 
geometric (1/2) random variable. Thus, E x [r] = 0(e~ 2 ). Applying the optional stopping 
time theorem for submartingales, 

u(x) = E X M < E X M T = E x u(x T ) + cE x re 3 = E x u(x T ) + 0(e). 



Thus, u\(x) > u(x) — 0(e). A symmetric argument gives u\(x) < u(x) + 0(e), so \ui — u\ 
0(e), since u\ <u\. 

□ 

We now show that the solution u of A p u = g = — 2///3 has a natural game-theoretic 
interpretation as the limiting value of a modified tug of war game in which in addition to 
payoff player I receives when the game terminates, player I receives a "running payoff" of 
size f(xk)e 2 at the kth step of the game. 

Theorem 2.5. Suppose that u is smooth on a bounded domain O' D with non-vanishing 
gradient and A p u = g, where f = — fg is bounded below on Q by a positive constant. Then u 
is the limit as e — > of the functions u\ defined for tug of war with noise on Q, with running 
payoff f and boundary payoff given by F = u on dQ. 

Proof. The proof is exactly the same as in Theorem 12.41 (the estimates in Lemma [2731 include 
the running payoff case), except that we need a different argument to show that the expected 
number of turns in the game is 0(e~ 2 ). But since / is bounded below, if player I adopts the 
strategy of always pulling distance e in the gradient direction, either the expected number 
of turns in the game is less than 



snp n u(x) - inf e n F(x) 



inf f(x) 



-e 



-2 



in which case the arguments of Theorem 12.41 apply, or it is greater than this, in which case 
player I's expected payoff is even greater than u(x). 

On the other hand, player II can adopt a strategy which makes the process u(xk) + 
Yli=o f( x i) e2 ~ ckt 3 a supermartingale (for some constant c independent of e and x ). Since 
this supermartingale is bounded below, by optional stopping 



E 

Hence 



r-l 



U(X T ) + ^ f( X i) e2 - CTe3 



8=0 



E 



u(x T ) + t ( (inf f(x)e ) — ce 



< u(x ). 



< u(x ). 



Since u(x T ) is bounded on Q, this implies Er = 0(e 2 ). □ 
The remainder of this paper will focus on zero running payoff case / = 0. 
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2.3 Continuous boundary conditions, regular boundary 

Even if the boundary function F is continuous and u e converges pointwise to a function u, 
it may not be the case that u extends continuously to F on dfl. For example, in dimension 
two, if p < 2 and Q is the unit ball minus the origin and / is the function which is 1 at the 
origin and at the boundary of the unit ball, then it is not hard to see that as lim e ^ u\ = 
throughout Q, which is discontinuous at the origin. However, we will see that this cannot 
happen if Q is sufficiently regular. This section extends the results of the previous section 
to sufficiently regular domains by proving Theorem 11.21 

Proof of Theorem 1 1.21 (i) Suppose that Q is game- regular. Our strategy will be to use this 
fact to establish some a priori equicontinuity on the u\ that will ensure (via a compactness 
argument) subsequential uniform convergence of the u\ to a limit that extends continuously 
to F on dVt. Then we will use comparison arguments and Theorem 12.41 to show that any 
such limit is a viscosity solution to A p u = 0, which is unique by Proposition 11.51 

Fix a continuous F and write b^ = mm y £ qq F(y) and bu = max^gan F(y) . Given a 
constant 7, we can find a S such that \F(x) — F(y)\ < 7/2 whenever \x — y\ < S. We then 

defille V = 2(6^6U- 

By game-regularity, for each y G dQ we can find S = S (y) and e = e (y) such that for 
every x with \x — y\ < S and e < e , player I has a strategy that guarantees that an e-step 
game started at x will terminate at a point on dQ n B(y, S) with probability at least 1 — 77. 
The probability that F at the terminal point differs from the F(y) by more than 7/2 is at 
most 2(bJ-b L ) i so we nave t na t \u\(x) — F(y)\ < 7 for each x G B(y, So). 

By compactness of dQ (a closed bounded set), we can find a finite collection yi, . . . , y^ 
such that 

dncS = ul 1 B(y l ,S (y l )/2). 

Now, define 

So = dist(fi\S, dQ) A min S (yi)/2, 

l<i<N 

and eo = mini<j<jv co(Vi) A So/(2a). Every point x within distance So of dfl has the property 
that \u{(x)—u(x')\ < 27 for every x' with \x— x'\ < S and e < e , because x G B(y i} S (yi)/2) 
for some i, and hence x' G B(y i} So{yi)). This in turn implies that 

for every e < e and any x, x' G ft with \x — x'\ < So, we have \ul(x) — u\(x')\ < 27 . (4) 

The reason is that a player starting at x' can always adopt the same strategy that would have 
been chosen starting at x (i.e., define x', = Xj+x'—x and when the game position is some x' k _ x 
a player can choose the step that would be chosen if the game position were x^-i) up until 
the first time that dist(xfc, dfl) Adist(x^,, dfl) < So- At that point we have \u\(x' k ) —u\(xk)\ < 
27, and the result follows. By symmetry, the analog of (j3J) with u\ replaced by u\ also 
holds. Consider m x (x) := liminf e ^ M^(x) and U2(x) := limsup e ^ M2(x). The asymptotic 
equicontinuity (jl]) implies that u 1 and are (uniformly) continuous functions on Q which 
agree on dfl. If we can show that these functions are both p-harmonic, then uniqueness of 
extensions (Proposition 11.51) and the general inequality u\ < u\ will imply that the pointwise 
limits lim £ ^o w i( a; ) f° r ^ = 1,2 exist and coincide everywhere in Q. (Another application of 
01]) will then yield that the convergence is uniform.) 
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Using symmetry, it only remains to show that m 1 is p-harmonic. By Proposition 11.31 it is 
enough to show that u\ is a viscosity solution of A p u = in Q. We will verify that u x is a 
viscosity subsolution; the proof that it is a supersolution is similar. 

Let (f) be a C 2 function in a neighborhood Vq of x £ Q such that <p(x) = Ui(x), the 
inequality m x < holds in V and V0(x) 7^ in Vq. We must show that A p <p(x) > 0. 
Otherwise, there exist r > and 9 > such that A p < —6* on B(x,r) C Vq. Let 



denote g = A p <f) < A p (f) + 9/2 < —0/2, and consider noisy tug of war played in B(x, r) with 
stepsize e, running payoff / = — fg > ^ and boundary values on dB(x,r). By Theorem 
12.51 the value functions for player I in this game (which must be greater than u\ for small e 
due to the positive running payoff and the larger boundary values), converge as e — > to <f>. 
This is a contradiction, since < Ui(x). Thus we have shown that A p <p(x) > 0, and the 
proof is complete. 

Proof of Theorem ll.2( ii). Suppose that for every continuous F, the u\ converge 
uniformly. Then we claim that y is game regular, i.e., i.e., that for every S > and rj > 
there exists a 5 and e such that for every x with \x — y\ < 5 and e < e , player I has 
a strategy that guarantees that an e-step game started at xq will terminate at a point on 
dfl n B(y,S) with probability at least 1 — 77. To see this, define F(y') = — \y — y'| on <9Q 
and let u be its extension. Given S and 77 we can choose 5 such that |x — y\ < 5 Q implies 
\u(xo) — u(y)\ < f]5/2. By uniform convergence, we can find eo such that for e < eo we have 
I \u\ — u\ loo < 7]5/2 which implies that |u^(xo)| < 1]5, and hence player one has a strategy 
that guarantees that the probability of ending 5 away from y is at most rj. □ 

2.4 Sufficient conditions for regularity 

We first present a condition equivalent to game-regularity which is easier to verify. 

Lemma 2.6. Fix p > 1, a measure 11 as in the introduction and a domain Q C Mr. A 
point y G dQ is a game-regular boundary point of Q if and only if there is some 9 > with 
the following property: for every 5 > there exists a 5q and eo, such that for every xq with 
\ x o ~ y\ < $o an d e < e o? player I has a strategy that guarantees that an e-step game started 
at Xq will terminate at a point on dQ before exiting B(y, 5) with probability at least 9. 

Proof. Given 9 as in the statement of the lemma and n as in the definition, find k such that 
(1 — 9) k < rj. For e Q and <5 as in the statement, there exist Si and E\ such that for every x 
with |x — y\ < Si and e < ei, player I has a strategy that guarantees that an e-step game 
started at xq will terminate at a point on dQ before exiting B(y, Sq — ae), with probability 
at least 9. Iterating this argument k times proves the lemma. □ 

The following is needed for the proof of Proposition ll.lt 

Lemma 2.7. Fix p with 1 < p < 00. Given positive constants r,s,t,e with < s < 1 < t, 
consider an e game of tug of war with noise on an annulus B(0,tr)\B(0, sr) with 1 < p < 00 



<t>{v) = + -ri(y - x ) T (y - x ) 



9f_ 
~8d ' 
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and < s < 1 < t. If the initial game position is some xq with \xq\ — at < r < \xq\ + ae, 
and the ratio t/s is held fixed, then as — — > 0, player I has a strategy that guarantees that 
the game position will terminate on dB(0, sr) (instead of dB(0,tr) ) with probability at least 
b — O(f^) where 

t c — 1 

b = b(s,t,p,d) : = — — 



where c = c(p,d) : = £— p (As in Theorem \2.J\ the constant implied by O(-) may depend on 
Proof. Given d > 1 and p > 1 and x G M d \{0}, we write 



PdA x ) 



log \x\ p = d. 



where c = c(p, d) = ^^j. The reader may check that for each 1 < p < oo the function Pd,p(x) 
is a radially symmetric p-harmonic function on IR d \{0}. Taking F to be the function that 
has these values on the boundary of the annulus and applying Theorem 12.41 we see that if 
r, s, and t are fixed, player I can achieve a probability of reaching the inside first that is, up 
to an 0(e) error, given by 

Pd )P {tr) - p d ,p(r) (tr) c - r c t c - 1 
Pd, P (tr) - p d ,p(sr) (tr) c - (sr) c t c - s c ' 

(A similar argument applies when p = d.) If only the ratio t/s is fixed, then the fact that 
the error is O(-) follows similarly from Theorem 12.41 and a rescaling that replaces e with 
e' = ej (rs) and replaces r with r' = rj (rs) (so that r's = 1 and r't is fixed). 

□ 

Proof of Proposition 11.11 (i) We first prove that all domains are game-regular when 
p > d. Fix s = 1/2 and t — 2. Then since c(p,d) > 0, we have b = b(s,t,p,d) > 1/2. 
Consider the domain Q = M. d \{0}. For each integer m > 0, write r m = 2 m ae and let A m 
denote the closed annulus centered at with radii r m + ae and r m — ae. 

By Lemma 12.71 if the game position begins at xq G A m , and m > 1, then Player I can 
arrange, with probability at least b — 0(e/r m ) = b — 0(2~ m ) to have the game position enter 
A m _i before entering A m+1 . Next, let P m denote the infimum over all starting points x G A m 
of the maximum probability with which player I can guarantee that the game position hits 
B(0, ae) before hitting A m+ %. It is not hard to see that P m > for every m > 1. (If player 
I wins a long sequence of coin tosses — and chooses a length e vector uniformly at random 
each time — then the game position will undergo a symmetric random walk that moves by at 
most ae at each step. It is enough to observe that any such random walk hits B(0, ae) before 
A m+ i in some fixed number of steps with a probability that is bounded below independently 
of the choice of starting position in A m .) Since player I can arrange to have at least a 
b-m — b — 0(2~ m ) chance of reaching A m _i before A m+ i when the game positions starts in 
A m , we have 

Pm — b m (^P m —\ "I - (1 Pm—l)Prr 
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Rearranging terms, we get 



(1 b m b m P m —\)P m — b m P-i 



m—1 



and hence 



Pm > 




m—1 



The right hand side is less than or greater than P m _i as P m -i is, respectively, greater than 
or less than 2 — From this it is not hard to see that P m is bounded below independently 
of m. In fact, liminf P m > 2 — b^ 1 . 

Now, to prove game-regularity, we must show that there exists 9 > such that for every 
5 > 0, there exists a 5o and eo with the property that for every x with \xo — y\ < 5o and 
any e < eo, player I has a strategy that guarantees that an e-step game started at xo will 
terminate at a point on dfl fl B(y,5) with probability at least 9. We may take 5q = S/4, 
so that for every sufficiently small e we have 5q < r m < r m+1 < 5 for some m. Then if 
\ x o ~ y\ < <5o> player I can arrange to reach B(y,e) (or terminate the game sooner) before 
exiting B(y,5) with probability at least P m , which is bounded below by some constant 9 
independent of m. 

(ii) The second part of the proposition states that all domains having the cone property are 
game-regular. Assume without loss of generality that y — G dfl is the tip of the cone, and 
we will argue that y is game-regular. There exists some constant x £ (0, 1) and R such that 
for every r < R, there exists a ball of radius \r contained in C whose center is of distance r 
from the origin. If the game position begins at a point Xq whose distance is r from the tip of 
the cone, then player I can adopt the strategy of pulling towards the center of a ball of radius 
Xr centered at a point z in C (which is distance at most 2r away from xq). Then by Lemma 
12.71 f° r an sufficiently small e player one has a probability 9 (bounded below independently 
of e and r) of reaching this ball and terminating the game (or terminating the game even 
sooner) before exiting B(0,4r). The result now follows from Lemma [2.61 

(iii) Finally, we prove that all simply connected domains are game-regular when d = 2. By 
translation, we can suppose that G dQ. Our goal is to find 9 > 0, so that for any initial 
game position xo, for sufficiently small e player I can ensure that the game will end with 
probability at least 9 before the game position reaches a point outside of B(0,2\xq\). 

By rotating and scaling, we may and shall assume that x$ = (—2,3). Let Li be 
the ordered line segment in M 2 from (—2,3) to (1,-1). Let L 2 be the ordered line seg- 
ment from (1,-1) to (—1,-1) and let L 3 be the ordered line segment from (—1,-1) to 
(2,3). Let L be the concatenation of L%, L 2 , and L3 (a continuous path). Finally, let 
z = (—1, 2), z±, z 2 , . . . , Z1200 = (1, 2) be an evenly spaced sequence of points along the path 
L, and let r = ^ Ll ^ + |^ + ^ = = 1/100 be the distance between adjacent Zi along the 
path L. If the game position begins at a point in B(zi,r) C B(z i+1 ,2r) for < i < 1199, 
then for any b' with < V < 6(1/2, 2,p, d) +0(r _1 ) player I can arrange (for all e sufficiently 
small) to reach a point in B(z i+ i, r) before exiting -8(0, 4r) with probability at least b'. Thus, 
if the game position begins at z , player I can arrange, with probability 9 = (b') 1200 , to hit 
each of the B(zi,r) without ever reaching a point of distance more than 4r from L. Since 
4r < dist(L,0), a simple topological argument (this is where d — 2 is used) shows that if 
lies on the boundary of fl and fl is simply connected, then the path obtained by joining 
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Figure 2: Path used to prove simply connected domains are game- regular 



subsequent game positions Xj in such a game sequence with line segments would have to sur- 
round and intersect itself — and would thus have to cross dQ since Q is simply connected. 
However, this also implies that at some point the game position is within ae of dfl, and thus 
the game must have terminated. We conclude that for all sufficiently small e, player I can 
arrange for the game to end with probability at least 9 = (&') 1200 before the game position 
reaches a point outside of B(0, 2|xo|)- The result follows from Lemma [2.61 

□ 



3 Variants 

3.1 Alternating turns 

We now introduce a two-player zero-sum game, called alternating turn tug of war (with 
noise). The rules are exactly the same as those of ordinary tug of war except that players 
alternate turns (with player I moving first) instead of determining turn order with coin tosses. 
In the alternating turn game, we define p = p{p) E [l,oo] by p — 1 'q 2 2 2 ' 2 instead of 

Cl,l+C2,2+1 

P ~ C 2 ,2 

Equivalently, p is such that for some j3 > 0, we have G\ % \ = (3q~ x and C% t i = fip~ l for 
i > 2 for some /3 > 0, where p" 1 + q^ 1 = 1. As in the random turn game, p is chosen so that 
if one player always chooses the vector Vf. to be some v with |u| = e, and the other player 
always chooses vy. to be —v, then for each k the variance of — Xk-i is proportional to pe 2 
in the direction of v and qe 2 in each direction orthogonal to v. 

As in the random turn case, we let <f)(x) = x T Ax + (£, x) (for £ G M. d ) be a quadratic 
function. Suppose that xq = and let ip(v) be the expected value of <j)(x\) = 4>{v\ + z%) if 
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player I chooses v\ = v. Then z\ has expectation zero and covariance matrix C given by 

Pq- l vv T + Pp-\\v\ 2 I - vv T ). 
Since Z\ has expectation zero, we have 

^(v) := E[<f>{v + Zl )\ = 4>{v) + Aij®[44], 

where z\ is the ith component of z{). 

We can also write this as £\ . AijCij. Note that ^2(vv T )ijAij = v T Av and ^ — 
TrA We can now write 



^(u) = 0(v) + (f3q- l )v T Av + (3p-\\v\ 2 TrA-v T Av) 
= 4>{v) + (/^g" 1 - Pp- x )v T Av + /3p">| 2 TrA 
= (fiq- 1 - ftp" 1 + l)v T Av + pp~ l \v\ 2r TrA + (£, v) 

and we can write ip(v) = (£, u) + v T Bv where B = — + 1)A + Pp' 1 (Tr A)I. 

We give the following alternating turn analog of Lemma 12.31 

Lemma 3.1. If<p is quadratic, then for any even k (in the alternating turn game) if player I 
makes the k + 1th move in the gradient direction, then regardless of what player IPs strategy 
is, we have 

E[<p(x k+2 )\h k ] > <f>(x k ) + f3A p <P(x k )e 2 + 0(e 3 ). 
The constant in the 0(e 3 ) depends only \\B\\ and |£| = \V<p(xk)\, as in Lemma \2. H 

Proof. It is enough to prove this for k = 0. We may assume Xq = and then with the 
gradient strategy x\ = e|£| _1 £ and V0(xi) = £ + 2Ax\. Therefore 

|V0(X!)| 2 - |V0(x o )| 2 = 4 V T A Xl + 0(e 2 ). 

Dividing by |V0(x o )| + |V0(zi)| = 2|f | + 0(e) gives 

|V0(xx)| - \V4>(x )\ = + 0(e 2 ) = eA^xo) + 0(e 2 ). 

If player I is moving at the first turn, player I can arrange — by pulling directly in the 
gradient direction — to have 

E[0(xx)] - cj>(x ) > | V0(x o )|e + (f3A p + A^) 0(ar o ) + 0(e 3 ). (5) 

When player II makes the subsequent move, the expectation is smallest (up to 0(e 3 ) error) 
if player II always pulls in the minus gradient direction. In that case we have 

E[0(x 2 )M-<Kxi) > -|W(zi)|e+i- ((3A P + A^cftxJ + Oie 3 ) 

( \ e 2 

= -(\V(/>(x )\ + eA oo 0(x o )Je + - (f3A p + AJ 0(x o ) + 0(e 3 ) . 
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Taking expectations and adding <^ gives 

E<f){x 2 ) - (j>(x ) > (3A p <P{x )e 2 + 0(e 3 ) , 
as claimed. □ 

The proofs of analogs of Theorem 12.41 Theorem 12.51 and Theorem 11.21 are exactly the 
same as in the random turn case. 



3.2 Direction selection and Spencer's game 

The following game (along with other variants) was introduced by Spencer (16] and studied 
in detail by Kohn and Serfaty [8|. We focus on the case d — 2, although many natural 
variants exist in higher dimensions. 

Fix Q, x, F as in tug of war and set xq = x. At each turn k, player II chooses a vector 
Vk of length exactly e. Player I then chooses a sign cr k £ {—1, 1} and sets Xk = Xk-i + Vk v k- 
Kohn and Serfaty were primarily concerned with convex domains, constant running payoff 
/ and zero boundary conditions F = (i.e., one player seeks to maximize the number of 
steps before the boundary of the domain is reached and the other player seeks to minimize 
that number). In this case, the relevant operator is Ai, i.e., we generally expect the limiting 
payoff function a to be a solution to Aim = —2/; however, many complicating issues arise in 
this setting that do not arise in tug of war, so the results here are somewhat more restrictive. 
Even on simple domains (such as the unit disc) with C°° boundary values F, the equation 
Aiii = may not have a unique solution. (For a concrete example, note that if the unit 
circle is parameterized by angle 6 £ [0, 27r), then the function cos(2#) can be extended to 
the interior of the unit disc in such a way that it is constant on vertical lines; it can also 
be extended to the unit disc in such a way that it is constant on horizontal lines. Both 
extensions are solutions to Aim = — at least in the sense that they are smooth and satisfy 
Aiii = wherever Vu 7^ 0.) We refer the reader to [8] for more discussion along these lines. 

Consider the following interpolation between tug of war and Spencer's game: as before, 
we set an initial game position xq £ Q. At the kth turn, we toss a p -1 -coin to determine how 
the game position is updated: with probability p -1 , x k is updated using the rule of Spencer's 
game described above (with player II choosing a vector and player I choosing the sign); with 
probability it is updated using the rule of ordinary tug of war (i.e., a fair coin is tossed, 
and the player who wins the toss chooses a v k £ B(0, e) and we set Xk = Xk-i + v k)- 

In this setting, the analog of Theorem 12.51 is even simpler to prove than in the other 
two cases, since we may deal with the two cases separately. First, if it is decided that 
the game position will be updated at the k + 1th step using the tug of war rule, then by 
pulling in the gradient direction, player I can arrange for E[0(xfe+i) — <p(xk) \ hk) to be at 
least A OQ (f)/2 + 0(e 3 ) when </> is smooth (and player II can arrange for K[</)(xk+i) — <f>(xk) I ^fc] 
to be at most A 00 (f)/2 + 0(e 3 )). 

This follows as a special (/x supported at the origin) case of the bounds given for tug of 
war with noise. Second, we claim if it is decided that the game position will be updated 
at the k + 1th step using Spencer's rule, it is similarly clear (using the Taylor expansion 
for <ft) that player II can arrange (by choosing the direction orthogonal to the gradient) for 
K[cj)(xk+i) — <f)(xk) I hk] to be at most Ai0/2 + O(e 3 ). If player I adopts the strategy of always 
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choosing a sign so that the inner product (<TkVk, V0(xfc)) is non-negative, then a similar 
Taylor expansion shows that E[0(xfc_i) — (f>(xk) \ hk] will be at least Ai0/2 + 0(e 3 ). Thus, 
before it is decided which update rule will be used, either player can arrange for the expected 
change, given the history, to be A p <j)/2 + 0(e 3 ). The remainder of the argument is the same 
as the one given for ordinary tug of war. 

A complete proof of an analog of Theorem 11.21 in this context is also possible, but the 
definition of game regularity must be symmetrized to require the same for player II as is 
required for player I. 

4 Irregular domains and discontinuous payoff functions 

4.1 Resolutive functions 

If either Q is game irregular or F is discontinuous (e.g., if Q is the unit disc and F is zero on 
points with rational angles and one on all other points), then we cannot expect there to exist 
a p-harmonic function on Q that extends continuously to F on dQ. There is still a natural 
notion of p-harmonic extension of F provided F is resolutive (as defined below; when p = 2, 
resolutivity follows from boundedness and Borel measurability) . However, in this setting, 
the u e defined above need not converge to that extension (as is clear in the example where Q 
is the unit disc and F is the characteristic function of the set of points of irrational angles). 

To generalize p-harmonic extensions to general domains and boundary conditions, it is 
conventional to define the upper class Up of F as the set of all functions u such that u is 
p-superharmonic in Q, u is bounded below, and \\m.m{ x ^ y u{x) > F(y) for all y G dQ. The 
lower class Cp can be analogously defined by writing v G Lp if — v G U-p. The function 
Hp = inf {u : u G Up} is the upper Perron solution of F in Q and H F = sup{w : u G Cp} 
is the lower Perron solution of F in Q. The upper and lower Perron solutions are either 
identically ±oo or everywhere finite and p-harmonic. In particular, when F is bounded, both 
H F and Hp are bounded and p-harmonic (Chapter 9 of [6]). 

We say that F is resolutive if H F and Hp agree and are p-harmonic in Q. If Q is regular 
then every continuous function on Q is resolutive; in fact, if Q is regular, then every bounded 
and lower semi-continuous F on dfl is resolutive (Chapter 9 of [6]). If i 7 ^ are resolutive and 
Fi F uniformly then F is resolutive. It is known that when p = 2 any bounded Borel 
measurable / : dQ —>■ R is resolutive. For general p, no such comparable result is known, 
and it is an open problem whether every Borel function is resolutive [6]. It is not hard to 
see that some simple discontinuous functions (e.g., the function that is 1 on points of the 
boundary with rational coordinates and on all other points, etc.) are resolutive for all p. 

4.2 Shrinking step sizes 

Consider the variant of tug of war called small-step-size tug of war played as follows: 
fix parameters Q, F, p, and x as in ordinary (either random turn or alternating turn) tug 
of war. One player chooses any real e > and the other player chooses any real e with 
< e < e . The players then play tug of war using using the parameter e. Clearly, the payoff 
of this game is liminf e ^ M<E if player I chooses eo and player II chooses e and limsup e _ +0 M e 
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if player II chooses eo and player I chooses e. The convergence in Theorem 11.21 implies the 
following: 

Corollary 4.1. If Q is game-regular, then for every continuous function F : dQ — > M, the 
value of small-step-size tug of war as a function of the initial game position is given by the 
unique p-harmonic function u that extends continuously to F on dQ. 

Let v be the value for player I of the following game called shrinking-step-size tug of 
war. Players begin by choosing an eo and e as in small-e tug of war, with the requirement 
that d(x ,dQ) > ae (so that the game does not end instantly). Subsequently, at each time 
j such that either 

1. d(xj, dQ) < ae, or 

2. for some m > 1, j is the smallest integer for which d(xj, dQ) < 2~~ m , 

player I chooses a new eo and player II chooses a new e < eo (again, with the requirement 
that d(xj, dQ) > ae), and the game continues. Clearly this game cannot terminate in finitely 
many steps, because the e used during a game step is always such that the distance from 
the boundary is at least ae (and hence it is not possible to reach the boundary and end the 
game during that step). We define the payoff to be the infimum of F(y) over all limit points 
y G dQ of the Xj, and if no limit point on dQ exists. Let v be the value for player II of the 
game defined analogously except that player I chooses the e and player II chooses the e (at 
each stage) and the payoff is the supremum of F(y) over all limit points of y G dQ, instead 
of the infimum. Clearly v < v. Now we have the following: 

Theorem 4.2. In shrinking-step-size tug-of-war on a domain Q with bounded boundary 
function F , as defined above, the following holds throughout Q: 

H F <v<v< H F . 

In particular, if F is bounded and resolutive, then its p-harmonic extension H F = Hp is 
the value of the game independently of which player chooses the eo and whether the payoff is 
taken to be the supremum or the infimum of F on the set of limit points the Xk- 

We will make some more observations before proving this result. When F is the charac- 
teristic function 1a for some A C dQ, the value Hp(x) is called the p-harmonic measure 
of A at x and written u> p (A,x,Q). It is well known (see, e.g., [6]) that if uj p (A,xq,Q) = 
for some xq in a connected domain Q, then u p (A, x, Q) = for all points x G Q. 

Theorem 14.21 is interesting in light of the fact that p-harmonic measure is non-additive 
even on null sets [TTJ. In fact, [UJ exhibits a disjoint finite collection {Ai} of resolutive sets 
with p-harmonic measure zero whose union is all of dQ. 

Interpreted game theoretically, this means that there can be a partition {A{\ of dQ such 
that for each i, there is a strategy that causes all of the limit points of the game play to lie 
outside of Aj with probability one. In other words, player I has a strategy for avoiding any 
one of the Ai with probability one (regardless of player IPs actions), even though player I 
clearly has no strategy for avoiding all of the A, with even positive probability. 
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Following Chapter 2 of |6J, given a compact subset K of fl, let W(K, fl) := {u G Co(fl) : 
u > 1 on i^} and define its p-capacity to be cap p (i^, fl) = inf u€W ( K ^ J n \Vu\ p . If U is open, 
define cap p (C7, fl) to be supremum of cap p (if, fl) over compact K C U; if E is arbitrary, then 
ca.p p (E,fl) is the infimum of cap p (t/, fl) over open sets U D E. From Chapter 9 of [6] we 
cite the following: 

Proposition 4.3. The set oj ' p '-irregular boundary points has p-capacity zero. 

Note also that a subset A of fl has p-capacity equal to zero if and only if A C <9(D\t4) 
(i.e., A has empty interior) and u p (A,x,fl) = for each x G fl\A [6]. By Theorem 14. 2\ 
u p (A,x,fl) is an upper bound on the value function for a game with payoff 1 on A and 
dfl \ A — with equality in the case that A is resolutive (which holds, in particular, if A is 
open or closed; see Chapter 9 of [6]). 

Thus, Theorem 14.21 gives a new interpretation of what positive p-capacity means: a 
resolutive set has positive p-capacity if and only if for some x G fl\A, this value is non-zero. 
In other words, the resolutive subsets of fl with positive p-capacity are precisely those sets A 
that a player can reach — with positive probability — from some x G fl\A in shrinking-step- 
size tug of war. 

One definition of a p-regular point is a point such that lim x ^ xo Hp (x) = F(xq) for 
each continuous F : dfl — > R. A point is irregular if it is not regular. It easy to see 
that game- regularity implies p- regularity (since Theorem 11.21 defines a p-harmonic extension 
explicitly in this case), but the converse is not known. It may be that equivalence of game- 
regularity and p-regularity depends very sensitively on the precise termination rule used near 
the boundary. For this reason, we consider the shrinking- step game to be more natural than 
the ordinary game when the domain is wildly irregular. 

Proof of Theorem 14. 21 Fix a bounded Borel measurable function F on the boundary of an 
arbitrary bounded domain fl C M. d . Suppose that u belongs toUp, i.e., the set of all functions 
u such that u is p-superharmonic in fl, u is bounded below, and liminf^y u(x) > F(y) for 
all y G dfl. 

It is enough to show that u is an upper bound bound on the value of shrinking-step-size 
tug-of-war for player one. Let fl m be the component of {x G fl : d(x, dfl) > 2~ m } containing 
x (which is non-empty for all sufficiently large m) and let fl m be any smooth domain with 
fl m C fl m C flm+i- Let u m be the p-harmonic extension to fl m of the values of u on dfl m . 
Then we know (recall Propositions II . 51 and 11.31) that this extension is unique and that u m < u 
on fl m . By Theorem 12.41 Player II can choose e small enough to ensure that the expected 
value of u(xk m ), where k m is the first k for which which Xk G" fl m , is at most u(x) (up to 
an error that can be made arbitrarily small, say smaller than 52~ m for some fixed 5 > 0). 
This implies that u{xk m ) — 5 X^Li 2~ m is a supermartingale in m; hence u(xk m ) almost surely 
converges to a limit V with KV < u(xq) + 5. Since the payoff for player I is at most V, this 
implies that the expected payoff for player I is at most u(xo) + 5. □ 

Corollary 4.4. If F is resolutive then the value of F on any subset of dfl of p-capacity zero 
of dfl makes no difference to the value of shrinking-step-size tug of war. Zero capacity sets 
cannot be reached with positive probability — i.e., if F is 1 on a set of p-capacity zero and 
on the rest of dfl, then u = identically. 
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Remark. As noted by the referee, similar results were proved by analytical means in the 
papers by Kurki [9] and Aviles-Manfredi [2]. 

4.3 Harmonic measure for A p and porous sets 

Here, we present an estimate for the p-harmonic measure of a porous set for 1 < p < 
oo, analogous to the estimate given for cUqo in [13]. Estimates of this type were derived 
analytically by 0. Martio, see Theorem 11.27 in [6]. Neverthless, we feel that the argument 
below shows how useful game theoretic intuition is for these problems. 

Recall that a set S in a metric space Z is A-porous if for every r G (0, diamZ) every ball 
of radius r contains a ball of radius Ar that is disjoint from S. An example of a porous set 
is the ternary Cantor set in [0, 1]. 

Theorem 4.5. Let ft, C R d , d > 1 be the closed unit ball. Let A G (0, 1/2) and let 5 > 0. 
Let S be a X-porous subset of dQ, and let S$ be the closure of the 5 -neighborhood of S. Then 
for some constant c = c(X,p) > we have 

lo p (S s , 0, fi) < 5°. 

The key to the proof of the analogous result in [T3] is that in tug of war without noise, if 
player I chooses a strategy of always pulling towards a point z at distance r from the initial 
game position xq, and z G B(z,R) C Q, then the limit as e —>■ of the probability that 
the game sequence {xj} will reach z before exiting B(z, R) is (R — r)/R; in particular, this 
limiting probability depends only on the ratio r/R. 

In our setting, this does not hold when p < d. However, if instead of targeting z one 
merely aims to reach the ball B(z,r ) for some r < r < R, then the (small e) limit of the 
probability of reaching this ball is a positive constant depending only on r/r and R/tq. 

The idea of the proof in [H] was to construct a finite sequence x , . . . ,Xk of points— 
with xo = z and Xk a boundary point in the complement of S$ — such that the distance 
between successive X{ most some constant r and the distance from any X{ to S is at most 
some larger constant R. Then player I can, with positive probability (call it C), reach x\ 
before exiting Br{x\). Subsequently, player I can, with probability C, reach x 2 before exiting 
_Br(x 2 )- Repeating, we see that with probability at least 1 — (1 — C) h , player I can win the 
game before exiting UBij(ij). The proof in [13] then shows that if player one fails at this, 
then the same strategy may be repeated on a smaller scale. The proof of Theorem 14.51 is 
identical to the one given in [H] except that instead of targeting a sequence of individual 
points (terminating at a point in one of the intervals of the complement of S$) one targets a 
sequence of small-radius balls (terminating at a ball that lies just outside Q and is incident 
to the center of one of the intervals of the complement of Sg)- 

5 Non- measurable strategies and finite additivity 

Some of the measurability restrictions we have imposed on strategies and on F can be 
relaxed by invoking some less standard mathematics (such as finitely additive probability 
and/or the Axiom of Determinacy) . There is a sizable stochastic game theory literature on 
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these subjects (see, e.g., [T3j [T2] and the references therein) and we will only briefly mention 
what the main results imply in our setting. 

First, the requirement that the players adopt measurable strategies is unnecessary if we 
require that all subsets of M. d be \i measurable (since the latter implies that all strategies 
are measurable). This can be achieved within Zermelo Fraenkel set theory with the Axiom 
of Choice (ZFC) by relaxing the requirement that /i be cx-additive. In this context, [131 f!2] 
define the expected payoff for every pair of strategies (mixed or pure), and the following is 
immediate from their more general result, which holds in ZFC: 

Proposition 5.1. Let Q be an arbitrary domain, x G £1, and F a Borel measurable payoff 
function. Suppose we require that the [i in the definition of tug-of-war is finitely additive and 
defined on all subsets of~R d , and that the players are allowed arbitrary finitely additive mixed 
strategies. Then all of the variants of tug of war we have introduced (alternating turn and 
random turn; fixed e and small- step- size and shrinking- step- size) have values u e . Moreover, 
u\<u e < u\, where u\ andu\ are defined (as in the introduction) using only pure measurable 
strategies. 

Recall that even for continuous boundary data, we did not resolve the issue of when u\—u\ 
under the restriction to measurable strategies (although we showed that \u\ = u^oo — ► as 
e — > 0). Proposition 15.11 gives a value for every finite e and every Borel boundary function 
F, which is at least compatible with our measurable-setting definition in that it is bounded 
between u\ and u\. 

The results of [T3] [12] also imply the existence of a value function for shrinking step 
size tug of war, and it is not hard to see (using comparison with smooth functions) that 
any such value function must be p-harmonic. We may interpret this function as a canonical 
p-harmonic extension of F — defined for every Borel measurable function F — (although we 
have not shown that it does not depend on /x). 

An even more exotic assumption — which allows us to use arbitrary payoff functions F — is 
the Axiom of Determinacy, which contradicts the Axiom of Choice but which implies that 
all stochastic games (in particular, tug of war games) have values for all bounded payoff 
functions on [13]. (It also implies that that all subsets of R are Lebesgue measurable 
[T3].) Under the Axiom of Determinacy, the value of shrinking-step-size tug of war exists 
(and is p-harmonic) for every bounded boundary function F : dQ — > R. 

6 Open questions 

We conclude with some simple open questions. We learned of the following question from 
0: 

Question 6.1. Are all Borel measurable functions F of dQ resolutive when Q is a bounded 
domain in R d ? 

If the answer is no, then one may still attempt to construct a canonical p-harmonic 
extension of F by affirmatively answering the following: 

Question 6.2. Does shrinking step size tug of war have a value (within standard ZFC, using 
measurable strategies ) for all Borel measurable F that depends only on p ( and not on any 
other properties of /j,)? 
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We showed that game-regularity implied p-regularity but could not prove the converse. 

Question 6.3. Is game-regularity equivalent to p-regularity? 

In [H], a game theoretic argument based on tug of war was used to prove uniqueness 
of solutions to A^u = g (given zero boundary conditions) for all sufficiently regular and 
strictly positive g — and to show that uniqueness failed in general if g was allowed to assume 
values of both signs. It is natural to ask whether these arguments can be adapted to the 
p-Laplacian. 

Question 6.4. Let Q be a bounded, game-regular domain and g a Lipschitz function on Q 
with mf x£ Q g(x) > 0. Does there necessarily exist a unique solution to to A p u = g? Does 
this uniqueness fail when g is allowed to assume values of both signs ? 

Theorem II .21 shows that u\ and u\ converge to the same limit, but we have not addressed 
the following: 

Question 6.5. In the setting of Theorem ! 1.21 is it always the case that u\ = u e 2 ? 
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